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ABSTRACT 

The National Association of Counties (NACo) conducted 
a mail survey of service delivery areas (SDAs) to disprove 
allegations that 40 percent of them had not been audited since the 
start of the Job Training Partnership Act (JTPA) in 1983. A 
questionnaire was developed and mailed to every third SDA on a list 
of all SDAs. Of 244 SDAs, 235 or 96 percent responded. All responding 
SDAs indicated they had been audited. Nearly all (92 percent) had 
been audited within the past 24 months. Eighty-nine percent indicated 
they were audited once each year; 91 percent indicated they were 
subject to the Single Audit Act. Data showed that 54 percent of the 
SDAs subject to a single audit were part of a larger city-, county-, 
or statewide audit, which could indicate that in a single audit 
procedure, SDAs that were part of larger audits would be '^rolled 
into** the larger audit and be reported as part of the larger audit. 
Data also suggested that when an SDA had greater control over its 
audit, tho scope of the audit was lilcely to be more inclusive than 
when the audit was part of one for larger governmental units. More 
than half of all SDAs that were subject to A-110 audits seemed 
inclined to ensure that their SDAs were also in conformance with the 
Single Audit Act. (The survey instrument is attarned.) (YLB) 
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AUDTTING JTPA 



Introduction 

From 1 983 to 1988, the Job Training Partnenhip Act 
received widespratd support from Congress, the 
Administration and media. Since then, the pro- 
gram has come under increased scrutiny and at- 
tack. 

During its first five years, JTPA was lauded as the 
program that was uniquely qualified to meet the 
needs of economically disadvantaged persons 
seeking to make the tnmsidon from economic 
dependence to economic self-sufficiency. The 
public/private partnership between government 
and the private sector which JTPA established was 
just one of the many aspects of the program which 
supporters and critics, alike, praised. 

During the past two years, however, many groups 
in and out of government have urged program- 
matk: changes to JTPA. For example, some have 
argued that the program needs to be restructured 
to insiu% that: services are targeted to those most in 
need of job training and placement assistance; serv- 
ices are appropriate to the needs of JTPA clients; 
individuals are trained to insure longtenn employ- 
ability and income gains; and procurement proce- 
dures are tightened up to insure fiscal integrity of 
the program These issues have been raised by Con- 
gress, theOffice of Management and Budget (0MB), 
and the Office of Inspector General (OIG), among 
others. And etibrts to answer those questions have 
led to increased Department of Labor (DOL) pro- 
grammatic and fiscal reviews. It is the fiscal integ- 
rity of JTPA — especially with regard to auditing 
practices — that is the focus of this report. 



Background 

On December 5, 1989, Senator John Glenn (D-OH), 
chairman of the Senate Committee on Governmen- 
tal Affairs, released a list of programs identified for 
the Congress by 0MB as being at high risk for fraud 
andabiue. That list dted 73 specific programs in 
which hundreds of billions of federal dollars were 



believed to be at risk. Among those dted were: 

• the Internal Revenue Service, which has failed to 
collect $63 billion in delinquent taxes; 

• the Department of Defense's $103 billion supply 
operations; aiKl 

• a shortfall in Social Security Administration 
employee earnings records of $58.5 billion. 

The list, based upon information supplied by the 
US Department of Labor (DOL) to 0MB, induded 
the allegation that: 

programs operated imder the Job Training Part- 
nenhip Act were considered at risk for hvad 
and abuse because of the overall hulure of the 
program to meet the requirements of the Single 
Audit Ad. 

The committee report stated: 

Audit coverage under JTPA is not in compliance 
with the requirements of the Single Audit Ad. 
The adequacy of this audit coverage in provid- 
ing reasonable assurance that State internal con- 
trols are properly in place needs to be assessed. 
In the 42 States where compliance reviews have 
been conduded, 14 States have not issued a 
State-level audit report and 40 percent of the serv- 
ice delioery areas and 30 percent of the subredpient 
programs have not had an audit report issued since 
the start of JTPA in 1983. Whether the scope of 
coverage under the Single Audit Ad is adequate 
to provide reasonable assurance of internal con- 
trols also needs to be assessed, since this cover- 
age does not require specific financial audits of 
CXDL programs or funds. A full analysis of 
defidendes and remedies should be developed, 
including an explanation of how the 
Admiiustration's proposed JTPA amendments 
would address this problem. 

Could it be that 40 percent of all service delivery 
areas (SDAs) have not had an audit report issued 
since the start of JTPA in 1983? Could it be that, by 
implication, 40 percent of all SDAs have not been 
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audited since 1983? Could it be that nearly half of 
the $21.5 billion that has beA alloted to the states 
since JTPA was implemented has not been ac- 
counted for? 

The National Association of Counties' concluded 
that it was not possible that billions of dollars were 
wasted and that SDAs chose not to report their 
activities. In order to determine the accuracy of 
these allegations, the National Association of 
Counties (NACo) developed a "Survey on JTPA 
Audits" to determine the extent to which local Job 
Training Partnership Act programs have been 
audited. It was NACo's assumption that local JTPA 
programs were audited imder the provisions of 
either the Single Audit Act, commonly known as an 
A-1 28 audit, or guidelines for private not for profit 
organizations receiving federal funds, an A -110 
audit. It was also NACo's assumption that every 
SDA within the JTPA system has been audited 
within the last 24 months. 



The Study 

In Older to obtain information from a large number 
of local programs, the decision was made to con- 
duct a mail survey of a randomly selected group of 
SDAs. A questionnaire (see "Attachment") was 
developed. It was designed to gather information 
on a wide range of issues, including: 

• the year of the most recent audit report; 

• whether the SDA is subject to an A-1 28 or A-1 10 
audit; 

• the scope of the audit; 

• whether a final audit report was issued; 

• the types oi monitoring which are included in the 

audit; and 

• whether the SDA has been or will be subject to 
audits by the Office of Inspector General (OIG). 

The questionnaire was mailed to 244 SDAs on 
February 21, 1990. SDAs which did not respond to 
the survey by March 7, 1990, were sent a reminder 
letter that asked them to complete the question- 
naire and return it to NACo as soon as possible. 
Those which did not respond to this request were 
contacted by phone, and when possible, interviews 
were conducted at that time. 



A standard formula for determining the size, i.e. 
the number of SDAs to include in the survey, was 
used. Itwasdeterminedthat244SDAswouIdhave 
to be surveyed to insure, with 90 percent certainty, 
that the results of the survey woukl be representa- 
tive of all SDAs within the JTPA system. Alistofall 
SDAs was compiled and a randonnly determined 
starting point was chosen for the selection of those 
SDAs included in the survey. To obtain the neces- 
sary number of SDAs for the sample, every third 
SDAwaschosenfromthestartpointinthelist This 
procedure iiuured that each SDA within the "imi- 
verse of SDAs" had an equal chance of being se- 
lected. 

Completed questionzuures were reviewed by staff 
and data were entered into a computer file. The 
data were aiudyzed utilizing simple frequency 
counts and two way croastables. 

NACo was concerned deeply that the sample be 
"representative" and that the return rate be suffi- 
dentiy large so that we could generalize the find- 
ings to the entire JTPA system. NACo had hoped 
to achieve a response rate in excess of 85 percent. 
To our pleasure, 235 or 96 percent of the SDAs in 
our sample responded, a response rate whkh per- 
mitted us to generalize our findings to all SDAs. 

The findings support our basic assertion that all 
SDAs have been audited subject to the provisions 
of A-128 and A-1 10 audits; that most SDAs have 
been audited within the past 24 months; and that if 
there is a problem with JTPA audits, the problem 
lies with the Single Audit Act, and not with the 
JTPA programs iSing audited through this proce- 
dure. 



Findings 

Ninety-six percent of the SDAs (235) in NACo's 
sample of 244 SDAs responded to ti\e survey. 

• All responding SDAs indicated that they have 
been audited. 

• Nearly all — 92 percent — indicated that they 
were last audited in 1988 or 1989. 

• Eighty-nine percent indicated that they are au- 
dited once each year. 
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• Ninety-one percent indicated that they were 
subject to the Single Audit Act (0MB Circular A- 
128). 

In addition, more than two-thirds (69 percent) 
indicated that procedures to monitor adxninistra- 
tivemanagementactivitiesand subcontractors were 
included in their audits, and conducted by their 
auditors. 

Of those SDAs that indicated that they have proce- 
dures in place to monitor administrative manage- 
ment activities and subcontractors in conjunction 
with their audits: 

• 75 percent indicated that they monitor, as p^ of 
their audits, fraud aivl abuse; 

• 71 percent monitor grievance procedures; 

• 69 percent monitor affirmadve action activities; 

• 58 percent monitor fbced unit price performance- 
based contracts; 

• 60 percent monitor service provider procure- 
ment procedures; 

• 74 percent monitor eligibility determination and 
verification; 

• 61 percent monitor data validation; 

• 75 percent monitor summer youth employment 
and training program systems, policies and pro- 
cedures; 

• 69 percent monitor youth employment compe- 
tency systems; 

• 74 percent monitor relationships between serv- 
ices provided and plan; and 

• 67 percent monitor dislocated worker activities. 

Some of the SDAs monitor these activities volun- 
tarily, while others monitor these activities because 
their states require them to do so. While SDAs 
which are subject to A-1 10 audits are more likely to 
perform these monitoring functions, the differ- 
ences are not always statistically significant. For 
example, whereas 76 percent of SDAs subject to an 
A-1 10 audit monitor fraud and abuse and eligibil- 
ity determination and verification, 67 percent of 
those subject to an A-1 28 audit monitor those ac- 
tivities. Whereas 64 and 60 percent of those subject 
to an A-1 1 0 audit monitor tixed unit price perform- 
ance-based contracting procedures and service 
provider procurement procedures, respectively, 53 
and 55 percent of those subject to an A-128 audit do 
the same. 



Of those SDAs whkh indicated that they are sub- 
ject to a single audit, 54 percent stated that they are 
included in audits of larger governmental unit*. 
SpedficaUy, 28 or 16 percent of all respondent 
SDAs subfect to an A-128 audit stated that they 
were partofalargercitywkleaudit,59or 34 percent 
stated they were part of a larger countywide audit, 
and seven or four percent were included in a state 
wide audit. Of the remaining SDAs, 79 or 46 
percent stated that they were subject to a "stand 
alone'' audit, that is, they were audited independ- 
entiy of any larger governmental imit. 

Fifty (23 percent) of the SD^\s subject to a single 
audit responded atfimutively when asked if tlwy 
pefbrmed an independent audit. Interestingly, 
most of those who responded yes to peforming ai^ 
independent audit — 32 or 64 percent — stated that 
they were part of a staiKi alone single audit. Simi- 
larly, most of those who indicated that they include 
adcUtional monitoring activities in their audits stated 
that they were part of a staiul alone single audit or 
A-1 10 audit. Can it be SDAs which are subject to an 
A-1 10 audit or a stand alone A-128 audit are more 
likely to have an audit which informs them atwut 
their program and the effectiveness of the various 
activities in which the SDA is involved? Certainly, 
both sets of data suggest that when an SDA has 
greater control over their audit the scope of the 
audit is likely to be more inclusive than when the 
audit is part of one for larger governmental units. 
Of substantial interest was the finding that more 
than half of all SDAs which are subjet to A-1 10 
audits seem inclined to insure that their SDAs are 
also in conformance with the Single Audit Act. Of 
the 25 SDAs tiuit are subject to A-110 audits, 14 or 
56 percent indicated that they perform A-128 type 
audits to insure that their programs are in compli- 
ance with the requirements of the Single Audit Act. 



Conclusions 

Data gathered by MACo's Training and Employ- 
ment Programs conclusively demonstrate that every 
service delivery area within the ]TPA system has 
been audited. 

One-hundred percent of those SDAs which re- 
sponded to the survey indicated that they have 
been audited; 92 percent indicated that they were 
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audited within the last two yeaxs; and 91 percent 
indicated that they are subject to the Single Audit 
Act. 

Because the evidence is so conclusive, we must 
question the validity of the US Department of 
.Labor's claim that "40 percent of the service deliv- 
ery areas . . . have not had an audit report issued 
since the start of JTPA in 1983." We must ask, were 
the compliance reviews which "uncovered" this 
information conducted properly, and if so, did 
DOL disco ver a problem which has more to do with 

the Single Audit Act than it does with the fact of 
local programs being audited? While Senator 
Glenn's committee report does raise the latter 
question, the report seems to place the blame for 
many of the "problems" associated with locaiaudits 
at the feet of the local programs. 

Data from this study indicate that 54 percent of the 
SDAs subject to a single audit are part of a larger 
dty-, county-, or statewide audit. Can it be that 
some of these are the same SDAs about which the 
Department of Labor is concerned? In a single 
audit procedure, SDAs which are part of larger 
audits will be "rolled into" the larger audit, and be 
reported as part of the larger audit. A separate 
report may not be issued, though a well done single 
audit will uncover program specific fiscal prob- 
lems, identify those problems and identify the 
agency or governmental unit which should take 
corrective actions. 

If, ultimately, the Departtnent of Labor, the Office 



ofManagementand Budget and theCongresscome 
to agree that reform of the Single Audit Act is 
necessary, especially with regard to JTPA, tiiere 
does appear to be merit to the position that SDAs 
should be subject either to stand alone A-128 or 
independent A-110 audits. These audits, as we 
have seen, tend to be more comprehensive. They 
focus on a wide range of programmatic issues other 
than finances: fraud and abuse, grievance proce- 
dures, affirmative action, fixed imit price perform- 
ance-based contract8,serviceproviderprocurement 
procedures, and data vaUdation, among others. 
The result is that substantially more is learned 
about the SDA through the audit procedure. 

The National Association of Counties believes that 
the US Department of Labor, the Office of Manage- 
ment and Budget and the Senate Committee on 
Governmental Affairs have done a substantial dis- 
service to the tuition's job training system. Ourdata 
document that local job tiaining programs have 
been audited. Therefore, respotwibility for the 
audit problems identified does not lie with local job 
training programs or with the JTPA system as a 
whole. However, there can be no question that if 
DOL cannot identify those audit findings which 
pertain to local job training programs then some- 
thing must be done. The National Association of 
Counties believes that it is now the responsibility of 
DOL, OMB and the Senate Governmental Affairs 
Committee to determine what the real problem is 
and to place responsibility for that problem where 
it really belongs; not at the feet of JTPA. 
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Auditing JTPA 
Attachment 



February 21, 1990 



Dear jTP A Administntor 

On December 5, 1989, Senator John Glenn (D-OH) released a list of 73 federal programs which are considered at 
risk. This list, developed the Office of Management and Budget (OMB), included programs considered 
vi'lnerable to fraud, was&3 and abuse. Hundreds of billions of dollars are considered at risk. 

The Job Training Partnership Act (JTP A) program was among those considered to be "HIGH RISK." While 
accounting for a relatively smaU proportion of the total funds considered at risk the 0^ has failed 
billionin delinquent iaxesand substantial weaknesses in the Defense Cei^uiri^enf s$103billion supply operation 
were dted — JTPA again was identified as a program at which Congress should take a careful look. 

Specifically, OMB alleges that: 

Audit coverage under the Job Training Partnership Act (JTPA) b not in compliance with the re- 
quirements of the Single Audit Act. Theadequacy of this audit coverage in providing reasonable 
assurance that State internal controls are properly in place needs to be assessed. In the 42 States 
where compliance reviews have been conducted, 14 States have not issued a State-level audit 
report and 40 percent of the service delivery areas and 30 percent of the subredpient programs 
have not had an audit report issued since the start of JTPA in 1983. 

We at the National Association of Counties (NACo) and the National Association of County Training and 
Employment Professionals (NACTEP) want to learn more about the ways in which service delivery areas are 
audited. We have developed a brief questionnaire for you to complete and return to us. Please con.plete this 
questionnaire and return tous by March 7. Your answers will be kept confidential. At no time will we report what 
you or any other administrator said. Rather we will aggragate the responses of all 245 administrators, analyze 
it, and present our findings to Congress and the Administration. It is important that you complete this 
questionnaire and return it to us by March 7 so that we can respond adequately to th\^ allegations. 

On the following page you wil 1 find more detailed information about how you were selected to participate in this 
survey and certain confidentiality issues which we feel are of great importance to you and us. If you have any 
questions about the survey please call Neil Bomberg of the NACo staff at 202/393- 6226. 

Sincerely yours, 



Jerald T. McNeil, Director 
NACo Training and 
Employment Programs 



Qyde McQueen, President 
National Association of County 
Training and Employment Professionals, and 
President, Full Employment Council, 
Kansas City, Missouri 



Survey on JTP A Auorrs 



The purpose of this survey is to gather information on the variety and 
number of audit types used to evahiate the fiscal management proce- 
dures of local job training programs. Yours and 244 other service 
delivery areas were selected to participate in this survey through a 
procedure known as a ''systematic sample/' 

The answers which you will provide to N ACo and NACTEP will be kept 
strictly confidential No one, other than NACo staff working on this 
survey, will have access to your specific answers. Only aggragate data 
will be made available to the flPA community, the Congress, the Ad- 
ministration or any other interested party. No individtul respondent or 
service delivery area will ever be identified. After we have tabulated the 
results of this survey, all returned questionnaires will be destroyed. 

The number that appears at the top of the survey instrument helps us 
keeptrackof who has responded and who hasnot. Upon receipt of your 
questionnaire a notation will be made that your questionnare has been 
returned. The identifying niunber will be removed so that no one will 
ever be able to Unk your answers to you or your SDA. If we do not 
receive your questionnaire within two weeks of this mailing we will 
follow-up with a reminder post card asking you to complete the ques- 
tionnaire immediately. 

We need your help in this effort. The only way we can have the facts 
about local program audits is if you answer this brief questionnaire. But 
be assured that all of the information will be kept in strictest confidence, 
that no pennanent record showing your answers will ever be created, 
and that all records will be destroyed after we have been able to tabulate 
the answers from this survey. 

If I can answer any questions you might have atx>ut this questionnaire 
and what it means for your service delivery area, please call me on 202/ 
393-6226. 

Thank you for your cooperation. 



Neil E. Bomberg 
NACo research associate 
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y^i folUrm is a aeries of questum on the types and frequency of audits performed within 
yourservicedeHveryarea. Please answer each question whichappliestoyoursermceddiven/ 
area. V^lhm a series of dioices are given, cirde the number that corresponds to the answer 
thai is appropriate for your service delivery area. 

Please complete and return this questionnaire to: 

NeU E. Bomberg, Research Associate 
National Association of Counties 
440 First Street, NYf 
Vfeshington, DC 20001 



1 . For which program year was the most recent audit of your service delivery area performed? 

Program year for which last audit was done: i4.isax> 

2. How often is your service delivery area audited? 

Once a year 1 

Once every other year 2 

Other (specify: ) . 3 

3. Are you subject to an audit pursuant to the Single Audit Act (0MB Circular A-128)? 

Yes (Continue with Question 3A) . . 1 
^ No (Skip to Question 4) 2 ^^/a 

3A. Dufti^ the past year has your agency been audited persuant to the Single Audit Act 
(OMB Circular A-128)? 

Yes ... 1 
No. ..2 

3B. Is your "single audit" part of a city, county or statewide audit, a stand alone audit or 
something else? 



Part of a city audit 1 

Part of a cotmty audit 2 

Part of a statewide audit 3 

A stand alone audit 4 

Something else (Specify: ) . 5 
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3C. In addition to the "single audit" do you also hire a finn to perform an independent audit 
of your service delivery area? 

^ Yes (Continue with Question 3D) . . 1 
No (Skip to (Juestion 6) 2 

3D. Specifically, what type of independent audit is performed? 

Type of audit: 2^23«o 

3E In what year was the most recent independent audit of your service delivery area per- 
formed? 

Year of last independent audit: 19 24-as«o 

3F. How often do you contract with an independent audit firm to perform an audit of your 
service delivery area? 

Once a year 1 

0\ce every other year 2 

Other (Specify: ).3 ^ 

3G. Does your audit include a review of your management practices? 

Yes (Skip to Question 6) .... 1 

No (Skip to Question 6) 2 30/3 

4. Are you subject to an audit persuant to 0MB Circular A-UO, audits for not for profit organiza- 
tions? 

Yes (Continue with (Question 4A) .1 
No (Skip to (Question 5) 2 31/3 

4A. During the past year has your agency been audited persuant to an OMB Circular A-110 
audit? 

Yes ... 1 

No ... 2 3»3 

4B. How often do you contract with an independent audit ftrm to perform an A-110 audit of 
your service delivery area? 

•Once a year 1 

Once every other year 2 



Other (Specify: ) • 3 
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4C. Does your audit include a review of your numagement practices? 

Yet (Skip to Question 6) . . . . ! 
Mo (Skip to Question 6) 2 

4D. In addition to the A-110 audit, do you also hire a firm to perfonn an independent audit to 
insiire that your SDA is in compliance with the requirements of an A-128 single audit? 

Yes (Continue with (^estion 4E) . . 1 

No (Skip to (Juestion 6) 2 »• 

4E In what year was the most recent A-128-type independent audit of your service delivery 
area peiformed? 

Year of last independent audit: 19 »9rno 

4F. How often do you contract with an independent audit fiim to perform an A-128-type 
audit of your service delivery area? 

Once a year 1 

Once every other year 2 

Other (Specify: ) . 3 

5. If your SDA is not audited through a A-110 or A-128 audit, what type of audit do you receive? 



6. Do you have procedures in place for monitoring your administrative management activities and 
subcontractors? 

Yes, to monitor administrative management procedures (Continue with Q. 6A) . . 1 

Yes, to monitor subcontractors (Continue with Q. 6A) 2 

Yes, to monitor administrative management procedures and subcontractors 

(Continue with Q.6A) 3 

No (Skip to (Question 7) 4 

6A. Do you utilize in-house staff or contract with an outside firm to perform your monitoring 
activities? 

Utilize in-house staff, only 1 

Utilize an outside firm, only 2 

Utilize both in-house staff and an outside firm 3 
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6B. Is a written report issued on the monitoring activities? 



Yes (Continue with Question 6B1.) . . 1 



No (Skip to Question 6C) 2 *m 

6B1. How often is the report issued? 

Once a month 1 

Onceaquarter 2 

Once every six months 3 

Once a year 4 

Other (Specify: ) . 5 am 



6C. Of the following activities, which does your SDA monitor? 



Yes 



1. Fraud and abuse 

2. Grievance procedures 

3. Affirmative action/equal employment op. 

4. Fixed unit price performance bdsed contracts 

5. Service provider procurement procedures 

6. Eligibility determination and verification 

7. Data validation (follow-up data collection) 

8. Summer Youth Employment and Training 

Program systems, policies and procedures 

9. Youth Employment Competency systems 

10. Relationship between services provided 

and plan 

11. TiUein(EDWAAA) 

11 Other (Specify: 



) 



Yes, because it is No 

required by the state 

2 3 

2 3 

2 3 4*4 

2 3 so/A 

2 3 51/4 

2 3 52/4 

2 3 53/4 

2 3 54/4 

2 3 5»4 

2 3 

2 3 57/4 

2 3 56/4 



7. Have you been audited or will you be audited by the Office of Inpsector General (OIG) of the 
US Department of Labor? 

Have been audited (Continue with Q. 7A-B) ... 1 

Will be audited (Continue with Q. 7C) 2 

Have not been audited (Skip to end) 3 5*4 



7A. Have you been part of the OIG's contracts audit? 



Yes 
No 



60/3 



7B. Have you been part of the OIG's eligibility audit? 



Yes 
No 



1 
2 



61/3 
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7C. Were you selected to participate in the OIG's single audit survey? 

Yes 1 

No 2 



Thank you very much for taking the time to complete this questionnaire. The information you 
have provided us will be useful as we continue to represent your best interests before the 
Administration and Congress. A final report vrill be forwarded to you upon its completion. 
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ABSTRACT 

The National Association of Counties (NACo) conducted 
a mail survey of service delivery areas (SDAs) to disprove 
allegations that 40 percent of them had not been audited since the 
start of the Job Training Partnership Act (JTPA) in 1983. A 
questionnaire was developed and mailed to every third SDA on a list 
of all SDAs. Of 244 SDAs, 235 or 96 percent responded. All responding 
SDAs indicated they had been audited. Nearly all (92 percent) had 
been audited within the past 24 months. Eighty-nine percent indicated 
they were audited once each year; 91 percent indicated they were 
subject to the Single Audit Act. Data showed that 54 percent of the 
SDAs subject to a single audit were part of a larger city-, county-, 
or statewide audit, which could indicate that in a single audit 
procedure, SDAs that were part of larger audits would be '^rolled 
into** the larger audit and be reported as part of the larger audit. 
Data also suggested that when an SDA had greater control over its 
audit, tho scope of the audit was lilcely to be more inclusive than 
when the audit was part of one for larger governmental units. More 
than half of all SDAs that were subject to A-110 audits seemed 
inclined to ensure that their SDAs were also in conformance with the 
Single Audit Act. (The survey instrument is attarned.) (YLB) 
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AUDTTING JTPA 



Introduction 

From 1 983 to 1988, the Job Training Partnenhip Act 
received widespratd support from Congress, the 
Administration and media. Since then, the pro- 
gram has come under increased scrutiny and at- 
tack. 

During its first five years, JTPA was lauded as the 
program that was uniquely qualified to meet the 
needs of economically disadvantaged persons 
seeking to make the tnmsidon from economic 
dependence to economic self-sufficiency. The 
public/private partnership between government 
and the private sector which JTPA established was 
just one of the many aspects of the program which 
supporters and critics, alike, praised. 

During the past two years, however, many groups 
in and out of government have urged program- 
matk: changes to JTPA. For example, some have 
argued that the program needs to be restructured 
to insiu% that: services are targeted to those most in 
need of job training and placement assistance; serv- 
ices are appropriate to the needs of JTPA clients; 
individuals are trained to insure longtenn employ- 
ability and income gains; and procurement proce- 
dures are tightened up to insure fiscal integrity of 
the program These issues have been raised by Con- 
gress, theOffice of Management and Budget (0MB), 
and the Office of Inspector General (OIG), among 
others. And etibrts to answer those questions have 
led to increased Department of Labor (DOL) pro- 
grammatic and fiscal reviews. It is the fiscal integ- 
rity of JTPA — especially with regard to auditing 
practices — that is the focus of this report. 



Background 

On December 5, 1989, Senator John Glenn (D-OH), 
chairman of the Senate Committee on Governmen- 
tal Affairs, released a list of programs identified for 
the Congress by 0MB as being at high risk for fraud 
andabiue. That list dted 73 specific programs in 
which hundreds of billions of federal dollars were 



believed to be at risk. Among those dted were: 

• the Internal Revenue Service, which has failed to 
collect $63 billion in delinquent taxes; 

• the Department of Defense's $103 billion supply 
operations; aiKl 

• a shortfall in Social Security Administration 
employee earnings records of $58.5 billion. 

The list, based upon information supplied by the 
US Department of Labor (DOL) to 0MB, induded 
the allegation that: 

programs operated imder the Job Training Part- 
nenhip Act were considered at risk for hvad 
and abuse because of the overall hulure of the 
program to meet the requirements of the Single 
Audit Ad. 

The committee report stated: 

Audit coverage under JTPA is not in compliance 
with the requirements of the Single Audit Ad. 
The adequacy of this audit coverage in provid- 
ing reasonable assurance that State internal con- 
trols are properly in place needs to be assessed. 
In the 42 States where compliance reviews have 
been conduded, 14 States have not issued a 
State-level audit report and 40 percent of the serv- 
ice delioery areas and 30 percent of the subredpient 
programs have not had an audit report issued since 
the start of JTPA in 1983. Whether the scope of 
coverage under the Single Audit Ad is adequate 
to provide reasonable assurance of internal con- 
trols also needs to be assessed, since this cover- 
age does not require specific financial audits of 
CXDL programs or funds. A full analysis of 
defidendes and remedies should be developed, 
including an explanation of how the 
Admiiustration's proposed JTPA amendments 
would address this problem. 

Could it be that 40 percent of all service delivery 
areas (SDAs) have not had an audit report issued 
since the start of JTPA in 1983? Could it be that, by 
implication, 40 percent of all SDAs have not been 
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audited since 1983? Could it be that nearly half of 
the $21.5 billion that has beA alloted to the states 
since JTPA was implemented has not been ac- 
counted for? 

The National Association of Counties' concluded 
that it was not possible that billions of dollars were 
wasted and that SDAs chose not to report their 
activities. In order to determine the accuracy of 
these allegations, the National Association of 
Counties (NACo) developed a "Survey on JTPA 
Audits" to determine the extent to which local Job 
Training Partnership Act programs have been 
audited. It was NACo's assumption that local JTPA 
programs were audited imder the provisions of 
either the Single Audit Act, commonly known as an 
A-1 28 audit, or guidelines for private not for profit 
organizations receiving federal funds, an A -110 
audit. It was also NACo's assumption that every 
SDA within the JTPA system has been audited 
within the last 24 months. 



The Study 

In Older to obtain information from a large number 
of local programs, the decision was made to con- 
duct a mail survey of a randomly selected group of 
SDAs. A questionnaire (see "Attachment") was 
developed. It was designed to gather information 
on a wide range of issues, including: 

• the year of the most recent audit report; 

• whether the SDA is subject to an A-128 or A-1 10 
audit; 

• the scope of the audit; 

• whether a final audit report was issued; 

• the types oi monitoring which are included in the 

audit; and 

• whether the SDA has been or will be subject to 
audits by the Office of Inspector General (OIG). 

The questionnaire was mailed to 244 SDAs on 
February 21, 1990. SDAs which did not respond to 
the survey by March 7, 1990, were sent a reminder 
letter that asked them to complete the question- 
naire and return it to NACo as soon as possible. 
Those which did not respond to this request were 
contacted by phone, and when possible, interviews 
were conducted at that time. 



A standard formula for determining the size, i.e. 
the number of SDAs to include in the survey, was 
used. Itwasdeterminedthat244SDAswouIdhave 
to be surveyed to insure, with 90 percent certainty, 
that the results of the survey woukl be representa- 
tive of all SDAs within the JTPA system. Alistofall 
SDAs was compiled and a randonnly determined 
starting point was chosen for the selection of those 
SDAs included in the survey. To obtain the neces- 
sary number of SDAs for the sample, every third 
SDAwaschosenfromthestartpointinthelist This 
procedure iiuured that each SDA within the "imi- 
verse of SDAs" had an equal chance of being se- 
lected. 

Completed questionzuures were reviewed by staff 
and data were entered into a computer file. The 
data were aiudyzed utilizing simple frequency 
counts and two way croastables. 

NACo was concerned deeply that the sample be 
"representative" and that the return rate be suffi- 
dentiy large so that we could generalize the find- 
ings to the entire JTPA system. NACo had hoped 
to achieve a response rate in excess of 85 percent. 
To our pleasure, 235 or 96 percent of the SDAs in 
our sample responded, a response rate whkh per- 
mitted us to generalize our findings to all SDAs. 

The findings support our basic assertion that all 
SDAs have been audited subject to the provisions 
of A-128 and A-1 10 audits; that most SDAs have 
been audited within the past 24 months; and that if 
there is a problem with JTPA audits, the problem 
lies with the Single Audit Act, and not with the 
JTPA programs iSing audited through this proce- 
dure. 



Findings 

Ninety-six percent of the SDAs (235) in NACo's 
sample of 244 SDAs responded to the survey. 

• All responding SDAs indicated that they have 
been audited. 

• Nearly all — 92 percent — indicated that they 
were last audited in 1988 or 1989. 

• Eighty-nine percent indicated that they are au- 
dited once each year. 
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• Ninety-one percent indicated that they were 
subject to the Single Audit Act (0MB Circular A- 
128). 

In addition, more than two-thirds (69 percent) 
indicated that procedures to monitor adxninistra- 
tivemanagementactivitiesand subcontractors were 
included in their audits, and conducted by their 
auditors. 

Of those SDAs that indicated that they have proce- 
dures in place to monitor administrative manage- 
ment activities and subcontractors in conjunction 
with their audits: 

• 75 percent indicated that they monitor, as p^ of 
their audits, fraud aivl abuse; 

• 71 percent monitor grievance procedures; 

• 69 percent monitor affirmadve action activities; 

• 58 percent monitor fbced unit price performance- 
based contracts; 

• 60 percent monitor service provider procure- 
ment procedures; 

• 74 percent monitor eligibility determination and 
verification; 

• 61 percent monitor data validation; 

• 75 percent monitor summer youth employment 
and training program systems, policies and pro- 
cedures; 

• 69 percent monitor youth employment compe- 
tency systems; 

• 74 percent monitor relationships between serv- 
ices provided and plan; and 

• 67 percent monitor dislocated worker activities. 

Some of the SDAs monitor these activities volun- 
tarily, while others monitor these activities because 
their states require them to do so. While SDAs 
which are subject to A-1 10 audits are more likely to 
perform these monitoring functions, the differ- 
ences are not always statistically significant. For 
example, whereas 76 percent of SDAs subject to an 
A-1 10 audit monitor fraud and abuse and eligibil- 
ity determination and verification, 67 percent of 
those subject to an A-1 28 audit monitor those ac- 
tivities. Whereas 64 and 60 percent of those subject 
to an A-1 1 0 audit monitor tixed unit price perform- 
ance-based contracting procedures and service 
provider procurement procedures, respectively, 53 
and 55 percent of those subject to an A-128 audit do 
the same. 



Of those SDAs whkh indicated that they are sub- 
ject to a single audit, 54 percent stated that they are 
included in audits of larger governmental unit*. 
SpedficaUy, 28 or 16 percent of all respondent 
SDAs subfect to an A-128 audit stated that they 
were partofalargercitywkleaudit,59or 34 percent 
stated they were part of a larger countywide audit, 
and seven or four percent were included in a state 
wide audit. Of the remaining SDAs, 79 or 46 
percent stated that they were subject to a "stand 
alone'' audit, that is, they were audited independ- 
entiy of any larger governmental imit. 

Fifty (23 percent) of the SD^\s subject to a single 
audit responded atfimutively when asked if tlwy 
pefbrmed an independent audit. Interestingly, 
most of those who responded yes to peforming ai^ 
independent audit — 32 or 64 percent — stated that 
they were part of a staiKi alone single audit. Simi- 
larly, most of those who indicated that they include 
adcUtional monitoring activities in their audits stated 
that they were part of a staiul alone single audit or 
A-1 10 audit. Can it be SDAs which are subject to an 
A-1 10 audit or a stand alone A-128 audit are more 
likely to have an audit which informs them atwut 
their program and the effectiveness of the various 
activities in which the SDA is involved? Certainly, 
both sets of data suggest that when an SDA has 
greater control over their audit the scope of the 
audit is likely to be more inclusive than when the 
audit is part of one for larger governmental units. 
Of substantial interest was the finding that more 
than half of all SDAs which are subjet to A-1 10 
audits seem inclined to insure that their SDAs are 
also in conformance with the Single Audit Act. Of 
the 25 SDAs tiuit are subject to A-110 audits, 14 or 
56 percent indicated that they perform A-128 type 
audits to insure that their programs are in compli- 
ance with the requirements of the Single Audit Act. 



Conclusions 

Data gathered by MACo's Training and Employ- 
ment Programs conclusively demonstrate that every 
service delivery area within the ]TPA system has 
been audited. 

One-hundred percent of those SDAs which re- 
sponded to the survey indicated that they have 
been audited; 92 percent indicated that they were 
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audited within the last two yeaxs; and 91 percent 
indicated that they are subject to the Single Audit 
Act. 

Because the evidence is so conclusive, we must 
question the validity of the US Department of 
.Labor's claim that "40 percent of the service deliv- 
ery areas . . . have not had an audit report issued 
since the start of JTPA in 1983." We must ask, were 
the compliance reviews which "uncovered" this 
information conducted properly, and if so, did 
DOL disco ver a problem which has more to do with 

the Single Audit Act than it does with the fact of 
local programs being audited? While Senator 
Glenn's committee report does raise the latter 
question, the report seems to place the blame for 
many of the "problems" associated with locaiaudits 
at the feet of the local programs. 

Data from this study indicate that 54 percent of the 
SDAs subject to a single audit are part of a larger 
dty-, county-, or statewide audit. Can it be that 
some of these are the same SDAs about which the 
Department of Labor is concerned? In a single 
audit procedure, SDAs which are part of larger 
audits will be "rolled into" the larger audit, and be 
reported as part of the larger audit. A separate 
report may not be issued, though a well done single 
audit will uncover program specific fiscal prob- 
lems, identify those problems and identify the 
agency or governmental unit which should take 
corrective actions. 

If, ultimately, the Departtnent of Labor, the Office 



ofManagementand Budget and theCongresscome 
to agree that reform of the Single Audit Act is 
necessary, especially with regard to JTPA, tiiere 
does appear to be merit to the position that SDAs 
should be subject either to stand alone A-128 or 
independent A-110 audits. These audits, as we 
have seen, tend to be more comprehensive. They 
focus on a wide range of programmatic issues other 
than finances: fraud and abuse, grievance proce- 
dures, affirmative action, fixed imit price perform- 
ance-based contract8,serviceproviderprocurement 
procedures, and data vaUdation, among others. 
The result is that substantially more is learned 
about the SDA through the audit procedure. 

The National Association of Counties believes that 
the US Department of Labor, the Office of Manage- 
ment and Budget and the Senate Committee on 
Governmental Affairs have done a substantial dis- 
service to the tuition's job training system. Ourdata 
document that local job tiaining programs have 
been audited. Therefore, respotwibility for the 
audit problems identified does not lie with local job 
training programs or with the JTPA system as a 
whole. However, there can be no question that if 
DOL cannot identify those audit findings which 
pertain to local job training programs then some- 
thing must be done. The National Association of 
Counties believes that it is now the responsibility of 
DOL, OMB and the Senate Governmental Affairs 
Committee to determine what the real problem is 
and to place responsibility for that problem where 
it really belongs; not at the feet of JTPA. 
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Auditing JTPA 
Attachment 



February 21, 1990 



Dear jTP A Administntor 

On December 5, 1989, Senator John Glenn (D-OH) released a list of 73 federal programs which are considered at 
risk. This list, developed the Office of Management and Budget (OMB), included programs considered 
vi'lnerable to fraud, was&3 and abuse. Hundreds of billions of dollars are considered at risk. 

The Job Training Partnership Act (JTP A) program was among those considered to be "HIGH RISK." While 
accounting for a relatively smaU proportion of the total funds considered at risk the 0^ has failed 
billionin delinquent iaxesand substantial weaknesses in the Defense Cei^uiri^enf s$103billion supply operation 
were dted — JTPA again was identified as a program at which Congress should take a careful look. 

Specifically, OMB alleges that: 

Audit coverage under the Job Training Partnership Act (JTPA) b not in compliance with the re- 
quirements of the Single Audit Act. Theadequacy of this audit coverage in providing reasonable 
assurance that State internal controls are properly in place needs to be assessed. In the 42 States 
where compliance reviews have been conducted, 14 States have not issued a State-level audit 
report and 40 percent of the service delivery areas and 30 percent of the subredpient programs 
have not had an audit report issued since the start of JTPA in 1983. 

We at the National Association of Counties (NACo) and the National Association of County Training and 
Employment Professionals (NACTEP) want to learn more about the ways in which service delivery areas are 
audited. We have developed a brief questionnaire for you to complete and return to us. Please con.plete this 
questionnaire and return tous by March 7. Your answers will be kept confidential. At no time will we report what 
you or any other administrator said. Rather we will aggragate the responses of all 245 administrators, analyze 
it, and present our findings to Congress and the Administration. It is important that you complete this 
questionnaire and return it to us by March 7 so that we can respond adequately to th\^ allegations. 

On the following page you wil 1 find more detailed information about how you were selected to participate in this 
survey and certain confidentiality issues which we feel are of great importance to you and us. If you have any 
questions about the survey please call Neil Bomberg of the NACo staff at 202/393- 6226. 

Sincerely yours, 



Jerald T. McNeil, Director 
NACo Training and 
Employment Programs 



Qyde McQueen, President 
National Association of County 
Training and Employment Professionals, and 
President, Full Employment Council, 
Kansas City, Missouri 



Survey on JTP A Auorrs 



The purpose of this survey is to gather information on the variety and 
number of audit types used to evahiate the fiscal management proce- 
dures of local job training programs. Yours and 244 other service 
delivery areas were selected to participate in this survey through a 
procedure known as a ''systematic sample/' 

The answers which you will provide to N ACo and NACTEP will be kept 
strictly confidential No one, other than NACo staff working on this 
survey, will have access to your specific answers. Only aggragate data 
will be made available to the flPA community, the Congress, the Ad- 
ministration or any other interested party. No individtul respondent or 
service delivery area will ever be identified. After we have tabulated the 
results of this survey, all returned questionnaires will be destroyed. 

The number that appears at the top of the survey instrument helps us 
keeptrackof who has responded and who hasnot. Upon receipt of your 
questionnaire a notation will be made that your questionnare has been 
returned. The identifying niunber will be removed so that no one will 
ever be able to Unk your answers to you or your SDA. If we do not 
receive your questionnaire within two weeks of this mailing we will 
follow-up with a reminder post card asking you to complete the ques- 
tionnaire immediately. 

We need your help in this effort. The only way we can have the facts 
about local program audits is if you answer this brief questionnaire. But 
be assured that all of the information will be kept in strictest confidence, 
that no pennanent record showing your answers will ever be created, 
and that all records will be destroyed after we have been able to tabulate 
the answers from this survey. 

If I can answer any questions you might have atx>ut this questionnaire 
and what it means for your service delivery area, please call me on 202/ 
393-6226. 

Thank you for your cooperation. 



Neil E. Bomberg 
NACo research associate 
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y^i folUrm is a aeries of questum on the types and frequency of audits performed within 
yourservicedeHveryarea. Please answer each question whichappliestoyoursermceddiven/ 
area. V^lhm a series of dioices are given, cirde the number that corresponds to the answer 
thai is appropriate for your service delivery area. 

Please complete and return this questionnaire to: 

NeU E. Bomberg, Research Associate 
National Association of Counties 
440 First Street, NYf 
Vfeshington, DC 20001 



1 . For which program year was the most recent audit of your service delivery area performed? 

Program year for which last audit was done: i4.isax> 

2. How often is your service delivery area audited? 

Once a year 1 

Once every other year 2 

Other (specify: ) . 3 

3. Are you subject to an audit pursuant to the Single Audit Act (0MB Circular A-128)? 

Yes (Continue with Question 3A) . . 1 
^ No (Skip to Question 4) 2 ^^/a 

3A. Dufti^ the past year has your agency been audited persuant to the Single Audit Act 
(OMB Circular A-128)? 

Yes ... 1 
No. ..2 

3B. Is your "single audit" part of a city, county or statewide audit, a stand alone audit or 
something else? 



Part of a city audit 1 

Part of a cotmty audit 2 

Part of a statewide audit 3 

A stand alone audit 4 

Something else (Specify: ) . 5 



10 11 



3C. In addition to the "single audit" do you also hire a finn to perform an independent audit 
of your service delivery area? 

^ Yes (Continue with Question 3D) . . 1 
No (Skip to (Juestion 6) 2 

3D. Specifically, what type of independent audit is performed? 

Type of audit: 2^23«o 

3E In what year was the most recent independent audit of your service delivery area per- 
formed? 

Year of last independent audit: 19 24-as«o 

3F. How often do you contract with an independent audit firm to perform an audit of your 
service delivery area? 

Once a year 1 

0\ce every other year 2 

Other (Specify: ).3 ^ 

3G. Does your audit include a review of your management practices? 

Yes (Skip to Question 6) .... 1 

No (Skip to Question 6) 2 30/3 

4. Are you subject to an audit persuant to 0MB Circular A-UO, audits for not for profit organiza- 
tions? 

Yes (Continue with (Question 4A) .1 
No (Skip to (Question 5) 2 31/3 

4A. During the past year has your agency been audited persuant to an OMB Circular A-110 
audit? 

Yes ... 1 

No ... 2 3»3 

4B. How often do you contract with an independent audit ftrm to perform an A-110 audit of 
your service delivery area? 

•Once a year 1 

Once every other year 2 



Other (Specify: ) • 3 
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4C. Does your audit include a review of your numagement practices? 

Yet (Skip to Question 6) . . . . ! 
Mo (Skip to Question 6) 2 

4D. In addition to the A-110 audit, do you also hire a firm to perfonn an independent audit to 
insiire that your SDA is in compliance with the requirements of an A-128 single audit? 

Yes (Continue with (^estion 4E) . . 1 

No (Skip to (Juestion 6) 2 »• 

4E In what year was the most recent A-128-type independent audit of your service delivery 
area peiformed? 

Year of last independent audit: 19 »9rno 

4F. How often do you contract with an independent audit fiim to perform an A-128-type 
audit of your service delivery area? 

Once a year 1 

Once every other year 2 

Other (Specify: ) . 3 

5. If your SDA is not audited through a A-110 or A-128 audit, what type of audit do you receive? 



6. Do you have procedures in place for monitoring your administrative management activities and 
subcontractors? 

Yes, to monitor administrative management procedures (Continue with Q. 6A) . . 1 

Yes, to monitor subcontractors (Continue with Q. 6A) 2 

Yes, to monitor administrative management procedures and subcontractors 

(Continue with Q.6A) 3 

No (Skip to (Question 7) 4 

6A. Do you utilize in-house staff or contract with an outside firm to perform your monitoring 
activities? 

Utilize in-house staff, only 1 

Utilize an outside firm, only 2 

Utilize both in-house staff and an outside firm 3 
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6B. Is a written report issued on the monitoring activities? 



Yes (Continue with Question 6B1.) . . 1 



No (Skip to Question 6C) 2 *m 

6B1. How often is the report issued? 

Once a month 1 

Onceaquarter 2 

Once every six months 3 

Once a year 4 

Other (Specify: ) . 5 am 



6C. Of the following activities, which does your SDA monitor? 



Yes 



1. Fraud and abuse 

2. Grievance procedures 

3. Affirmative action/equal employment op. 

4. Fixed unit price performance bdsed contracts 

5. Service provider procurement procedures 

6. Eligibility determination and verification 

7. Data validation (follow-up data collection) 

8. Summer Youth Employment and Training 

Program systems, policies and procedures 

9. Youth Employment Competency systems 

10. Relationship between services provided 

and plan 

11. TiUein(EDWAAA) 

11 Other (Specify: 



) 



Yes, because it is No 

required by the state 

2 3 

2 3 

2 3 4*4 

2 3 so/A 

2 3 51/4 

2 3 52/4 

2 3 53/4 

2 3 54/4 

2 3 5»4 

2 3 

2 3 57/4 

2 3 56/4 



7. Have you been audited or will you be audited by the Office of Inpsector General (OIG) of the 
US Department of Labor? 

Have been audited (Continue with Q. 7A-B) ... 1 

Will be audited (Continue with Q. 7C) 2 

Have not been audited (Skip to end) 3 5*4 



7A. Have you been part of the OIG's contracts audit? 



Yes 
No 



60/3 



7B. Have you been part of the OIG's eligibility audit? 



Yes 
No 



1 
2 



61/3 
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7C. Were you selected to participate in the OIG's single audit survey? 

Yes 1 

No 2 



Thank you very much for taking the time to complete this questionnaire. The information you 
have provided us will be useful as we continue to represent your best interests before the 
Administration and Congress. A final report vrill be forwarded to you upon its completion. 
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